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Abstract. While two hidden Markov process (HMP) resp. quantum ran- 
dom walk (QRW) parametrizations can differ from one another, the stochas- 
tic processes arising from them can be equivalent. Here a polynomial- 
time algorithm is presented which can determine equivalence of two HMP 
parametrizations Mi,M2 resp. two QRW parametrizations Qi,Q2 in time 
0(|r|max(iVi,iV2)''), where iVi,iV2 are the number of hidden states in 
Mi,M2 resp. the dimension of the state spaces associated with Qi, Q2, and E 
is the set of output symbols. Previously available algorithms for testing equiva- 
lence of HMPs were exponential in the number of hidden states. In case of QRWs, 
algorithms for testing equivalence had not yet been presented. The core subrou- 
tines of this algorithm can also be used to efficiently test hidden Markov processes 
and quantum random walks for ergodicity. 

Keywords. Dimension, Discrete Random Sources, Hidden Markov Processes, 
Identifiability, Linearly Dependent Processes, Quantum Random Walks, 

1 Introduction 

Let a parameterized class of stochastic processes be described by a mapping 

<P:r (1) 

where V is the set of parameterizations and S is the corresponding set of stochastic 
processes. A stochastic process ^(P) as induced by the parameterization P is said to 
be identifiable iff 

$-\^P))^{P} (2) 

that is, iff the parameterization giving rise to it is uniquely determined. The entire class 
of stochastic processes ^(P) is said to be identifiable iff <P : V ^ ^(^) is one-to- 
one. The equivalence problem (EP) emerges when <1> is many-to-one and is to decide 
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whether two parameterizations Pi,P2 are equivalent, that is ^{Pi) — ^(^2)- Under- 
standing its solutions can significantly foster understanding of the classes of stochastic 
processes under consideration as it usually yields insights about the class' complexity 
and its number of free parameters. Therefore, apart from its theoretical relevance, it is 
an important issue in the practice of system identification (e.g. 1 18 1). 

Hidden Markov processes (HMPs) are a class of processes which have gained 
widespread attention. In practical applications, for example, they have established 
gold standards in speech recognition and certain areas of computational biology. See 
e.g. 1 19 6 7J for comprehensive related literature. In an intuitive description, a hidden 
Markov process is governed by a Markov process which, however, cannot be observed. 
Observed symbols are emitted according to another set of distributions which govern the 
hidden, non-observed states. Since observed processes can coincide although the non- 
observed processes on the hidden states can differ from one another, hidden Markov 
processes are non-identifiable. 

For hidden Markov processes, the EP was first discussed in 1957 13] (see also 
UTl for a subsequent contribution). It was formulated for finite functions of Markov 
chains (FFMCs), an alternative way of parametrizing hidden Markov processes where, 
as sets of parametrizations, the parametrizations discussed here, also referred to as hid- 
den Markov models (HMMs) in the following, models trivially contain FFMCs. The EP 
for hidden Markov processes was fully solved in 1992 [13|. The corresponding algo- 
rithm is exponential in the number of hidden states and therefore impractical for larger 
models. See L13 1 also for more related work. 

Quantum random walks ( QRWs) have been introduced to quantum information the- 
ory as an analog of classical Markov sources |[T]. For example, they allow emulation 
of Markov Chain Monte Carlo approaches on quantum computers. A collection of re- 
sults has pointed out that they would be superior to their classical counterparts with 
respect to a variety of aspects (see e.g. II15I2I16I ). However, although their mechanisms 
can be described in terms of elementary linear algebraic definitions, their properties are 
much less understood. The key element of a quantum random walk parametrization is 
a graph whose vertices are the observed symbols. Quantum probability distributions on 
the vertices are transformed by linear operations which describe the quantum mechani- 
cal concepts of evolution and measurement. It is easy to see that quantum random walks 
are non-identifiable. For example, any of the (infinitely many different) parametriza- 
tions with a graph of only one vertex yields the same, trivial process. The equivalence 
problem for quantum random walks has not been discussed before. 

Beyond the work cited in |fT3l , there is a polynomial-time solution to test equiva- 
lence of probabilistic automata 11211 where HMMs can be viewed as probabilistic au- 
tomata with no final probabilities fS). The crucial difference, however, is that probabilis- 
tic automata do not give rise to stochastic processes (distributions over infinite-length 
sequences), but to probability distributions over the set of strings of finite length. The 
algorithm presented in |21 ) decisively depends on this and therefore does neither apply 
for hidden Markov processes nor for quantum random walks. Conversely, by adding a 
stop symbol to the set of observed symbols, any probability distribution over the set 
of strings of finite length can be viewed as a probability distribution over the set of 
infinite-length symbol sequences. This way, it can be seen that our solution also applies 
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for probabilistic automata and therefore is more general than ll2TII 's solution. 

Overall, the purpose of this work is to present a simple, polynomial-time algorithm 
that solves the EP for both hidden Markov processes and quantum random walks: 

Theorem 1. Let S be a finite set of symbols and 

Mx,My resp. Qx,Qy (3) 

be two hidden Markov process resp. quantum random walk parametrizations giving rise 
to the processes {Xt)^ (Yt) emitting symbols from S. Let 

nx,nY (4) 

be the cardinalities of the set of hidden states in the hidden Markov models resp. the 
dimensions of the state spaces associated with the quantum random walks. Equivalence 
of (Xf), (Yt) can be determined in 

0{\S\m£ix{nx,nY}'^) (5) 

arithmetic operations. 

Remark L Note that a polynomial-time solution for the identifiability problem for 
HMPs does not provide a polynomial-time solution for the graph isomorphism prob- 
lem. There are both non-equivalent HMPs which act on sets of hidden states which 
are isomorphic as graphs (e.g. two HMPs both acting on only one hidden state which, 
however, have different emission probability distributions) and equivalent HMPs where 
underlying graphs are non-ismorphic (e.g. two HMPs, one acting on two hidden states, 
but emitting the symbol a with probability 1 from both states and the other one acting 
on only one hidden state, also emitting the symbol a with probability 1, both result in 
the stochastic process which generates aaaa.... with probability 1). 

Remark 2. In |f20^ it was described how to test HMPs for ergodicity. Plugging the al- 
gorithm for computation of a basis (see subsection |5.1| l into the generic ergodicity tests 
provided in |[20il renders these tests efficient. 

1.1 Organization of Sections 

The core ideas of this work are tightly interconnected with the theory of finitary pro- 
cesses. Therefore, we start by concisely revisiting their theory in section |2l We then 
introduce hidden Markov models and quantum random walk parametrizations and the 
mechanisms which give rise to the associated processes in section |3] In section |4] we 
outline how to most efficiently compute probabilities for both hidden Markov processes 
and quantum random walks. The algorithm and theorems behind our efficient equiva- 
lence tests are then presented in section |5] We finally outline some complementary 
applications of our algorithms and make some conclusive remarks. 
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2 Finitary Random Processes 

Throughout this paper, we consider discrete random processes (X^) that take values in 
the (fixed) finite alphabet E. We assume that the process emits the empty word □ at 
time t = 0. We denote the probability function p of {Xt) by 

p{ai ...at) := Pv{Xi = ai, . . . , Xt = at} (ai . . . a* G E*). (6) 

As usual, we set 

E* := \J (with = {□}) (7) 

t>o 

and note that E* is a semigroup under the concatenation wv € ^7^+* for w £ E" and 
w e |w| = ^ is the length of a word e i^^. 

For any t;, w e 17*, we define functions py,p'^ : E* -^R via 

p,{w):^p{wv)^:p-^{v) (8) 

and view M-^' as a vector space. ^(1; = vi...vt\w = Wi-.-Wg) generally denotes the 
conditional probability 

p{v\w) := Pr(Xs+i =vi,...,Xt+s =Vt\Xi =wi,...,Xs = Ws) 

p{v) if «; = □ .g. 
ifp{w)=0 
p{wv)/p{w) otherwise. 

Furthermore, the subspace 

TZ{p) := span{p„ \ vGE*} resp. C{p) := spanfp'" \ w€E*} (10) 

is the row space resp. column space associated with the (probabihty function p of) the 
random process (Xt). 

It is easy to see that TZ{p) and C{p) have the same vector space dimension. So we 
define the dimension of (Xt) (or its probabihty function p) as the parameter 

dim(Xt) = dim(p) := dim7^(p) = dimC(p) e Z+ U {00}. (11) 

For any I,JQ Z'*, we define the matrix 

Pij := [p(wi;)]„e/,^ej e R^^''. (12) 

Pij is called generating if rk (P/,/) = rk (Ps*. dim(p)) and basic if it is gen- 
erating and minimal among the generating P/j, that is |/| = \ J\ = dim(p) in case 
of dim(p) < 00. In that sense, we call (in slight abuse of language) I resp. J a row 
resp. column generator/basis and the pair (7 J) a generator/basis for p. 

We call a process (X^) finitary if it admits a (finite) basis. So the finitary processes 
are exactly the ones with finite dimension. 
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Remark 3. The dimension of a random process is known as its minimum degree of 
freedom. The term finitary was introduced in lfT2l . Finitary processes are also called 
linearly dependent II 141 . 

Theorem 2. Let (Xt) and (Yt) be discrete, finitary random processes (over S) with 
probability functions p and q. Let furthermore (IJ) be a basis for (Xt). Then the fol- 
lowing statements are equivalent: 

(a) p = q. 

(b) (/, J) is a basis for (Yt) and the equalities 

p{v) — q{v), p{wv) — q{wv) and p(wav) — q(wav) (13) 
hold for all choices ofv E I,w Cz J and a E S. 

Proof. Given a basic matrix Pjj together with the probabilities p{v) , p{wav) for 
all V G I,w G J, a E S, one can reconstruct p via a "minimal representation" (see, 
e.g., 013I14I2OI for details). o 



3 Parametrizations and The Equivalence Problem 

3.1 Hidden Markov Processes 

A hidden Markov process (HMP) is parametrized by a tuple A4 = (S, E, tt, M) where 

1. 5 = {.si, . . . , s„} is a finite set of "hidden" states 

2. E — [esa] E R^^^ is a non-negative emission probability matrix with unit row 
sums J2aeE ~ 1, ('-6. the row vectors of E are probability distributions on S) 

3. TT is an initial probability distribution on S and 

4. M = [rriij] E R"^^'^ is a non-negative transition probability matrix with unit row 
sums X]r=i "^ij ~ ^ '■^^ ™^ vectors of M are probability distributions on S 

The associated process [Xt) initially moves to a state s E S with probability tt^ and 
emits the symbol Xi = a with probability Esa- Then it moves from s to a state s' with 
probability m^s' and emits the symbol X2 = a' with probability eg' a' and so on. In the 
following, we also refer to a parametrization M. = [S, E, tt, M) as a hidden Markov 
model (HMM). 

3.2 Quantum Random Walks 

A quantum random walk (QRW) is parametrized by a tuple Q ~ [G, U, i/jq) where 

1. G = {U, E) is a directed, if -regular graph over the alphabet 2J 

2. [/ : C*^ — > C*^ is a unitary evolution operator where k := \E\ = K ■ \S\ and 

3. t/iq G is a wave function, that is | IV'o 1 1 = 1 (| | ■ 1 1 the Euclidean norm). 
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Edges are labeled by tuples (a, x),a ^ X!,x ^ X where X is a finite set with \X\ = k. 
Correspondingly, C'' is considered to be spanned by the orthonormal basis 

( e(^a,x) I {a,x) e E). 

According to fl\ some more specific conditions must hold which do not affect our con- 
siderations here. 

The quantum random walk [Xt) arising from a parametrization Q = (G, U, V'o) 
proceeds by first applying the unitary operator U to ijjQ and subsequently, with probabil- 
ity Ylx^x \ {U'^o)(a.x)\^^ "collapsing" (i.e. projecting and renormalizing, which mod- 
els a quantum mechanical measurement) LZ-iAo to the subspace spanned by the vectors 
^{a,x),x£X to generate the first symbol Xi = a. Collapsing L/'i/'o results in a new wave 
function ^/^i. Applying [/ to V'l and collapsing it, with probabihty^^g^^ \{U'<Pi)(a' ,x)\^ ^ 
to the subspace spanned by et^a'.x).xex generates the next symbol X2 — a'. Iterative 
application of U and subsequent collapsing generates further symbols. 

3.3 The Equivalence Problem 

The equivalence problem can be framed as follows: 



Equivalence Problem (IP) 

Given two hidden Markov models A^x, A^f or two quantum random walk parametriza- 
tions Qx, Qy, decide whether the associated processes {Xt) and {Yt) are equivalent. 



The equivalence problem can, of course, be solved in principle, in the spirit of The- 
orem |2] In order to efficiently solve it in practice, it suffices to be able to efficiently 
compute the following quantities: 

(1) A basis {I, J) for the finitary processes {Xt),{Yt) from their parametrizations 
Mx,My- 

(2) The corresponding probabilities p(w),p(?i'w),p(waw) for all choices of u e /, w G 
J, a e Z". 

4 Computing Probabilities 

We would like to point out that in the following we assume that all inputs consist of 
rational numbers and that each arithmetic operation can be done in constant time. This 
agrees with the usual conventions when treating related probabilistic concepts in terms 
of algorithmic complexity 1. 19.2 1.5 J . 
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4.1 Hidden Markov Processes 

Let now (Xt) be a hidden Markov process with parametrization Ai = {S, E, tt, M). 
Observe first that the transition matrix M decomposes as M = "Yliaes matrices 
Ta with coefficients 

{Ta)ij es,a ■ m^j (14) 

which reflect the probabilities to emit symbol a from state s,; and subsequently to move 
on to state Sj. Standard technical computations (e.g. lISl) reveal that that for any word 
ai . . .at £ 17*: 



p(aia2 ...at)= p{aia2 . . . at^i)p{at\aia2 . . . at-i) 



(15) 



where 1 = (1, 1)^ G M"^ is the vector of all ones. 
For further reference, we use the notations 

Tv '.= Ty^Ty^ . . . Ty^_-^Ty^ £ M"^" (16) 

for any v = vi . . . vt & S* as well as 

^(w) 7r^r„ e R^^" and ^{v) := Tyl e R"^^ (17) 

Remark 4. Note that computation of vectors and ^(u) is an alternative way to 

describe the well-known Forward and Backward algorithm [e.g. |7 |) since the entries 
of these two vectors can be identified with the Forward and Backward variables 

Pr(5,+i = s,|Xi=ai,...,X, -a,) (18) 
and (19) 

Pr('5's+i Si I Xs+i as+i, ...,Xs+t = Os+t) (20) 

where (St) is the (non-observable) Markov process over the hiddenstates S = (si, s„). 
4.2 Quantum Random Walks 

The following considerations can be straightforwardly derived from standard quantum 
mechanical arguments, see iU for a reference. 

The State Space 5" We write Q* for the adjoint of an arbitrarily sized matrix Q G 
C™^", (that is Q*j — a — ib if Qji = a + ib where usage of i as both a running index 
and a complex number should not lead to confusion). Let 

n := fc2 ^ \E\^. (21) 
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We will consider the set of self-adjoint matrices 

5" := {Q e I Q = Q*} (22) 

in the following, which is usually referred to as state space in quantum mechanics. 
As usual, <S" can be viewed as an n = fc^-dimensional real-valued vector space. To 
illustrate this let 

e„ := (0,...,0, 1,0,..., 0)"^ e C^,m= 1, ...,/;; and (23) 

m 

fm := (0, 0, i , 0, 0)^ e C^, m = 1, k. (24) 

m 

The self-adjoint matrices 

for all choices of 1 < rni,m2 < and mi ^ m2 for Fmim2 (since entries on the 
diagonal of self-adjoint matrices are real-valued) then form a canonical basis of <S" 

(note that EyTi^ 77^2 ~ ■^m2mi) ■Fmim2 ~ ■Fm2mi)* 

Linear Operations on 5" For a quantum random walk parametrization Q = {G = 
[S, E), U, ipo) we introduce the projection operators (fc := \E\) 

P„ : C'= ^ C^ V ^ J2 ^(a,x)e(a,x) (26) 

for all a e which reflects projection of tjj onto the subspace spanned by the 6(0 ^;) , x G 
X. We find that 

T„ : 5" ^ 5", Q ^ {PaU)Q{PaUr (27) 

is an R-linear operator acting on the state space 5". In analogy to the theory of hidden 
Markov models, where here the order on the letters has been reversed, we further define 

V ■— -Lvt-Lvt-l ■ ■ • -'-Vi-'-Vi ^ \^°) 

for any v = Vi . . .Vt G S* . 

Let now := ■0V'* G C*^^*^ be the self-adjoint matrix being associated with a 
wave function tjj € C'^. We recall that, by definition of the quantum random walk p 
with parametrization Q, probabihties p{v = vi...Vi) are computed as 

p{v^vi...vt) = ||(P„,C/)(P„,_J...(P,, (7)^-011' (29) 

which can be rephrased as (Q^o := V'oV'o ^ ^® linear trace functional, that is the 
sum of the diagonal entries) 

p{v = vi...vt) = tr T„,...T„,Q^, (30) 

which yields that probabilities p{v) can be computed by iterative apphcation of mul- 
tiplying n X n-matrices with n-dimensional vectors where we recall that Q,/,,, can be 
taken as an element of the n-dimensional vector space S". Note that Ty acts on Q^^ in 
the sense of <S" whereas the trace functional treats TyQ^^ as a matrix. 
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Forward and Backward Algorithm Note that application of the trace functional can 
be rephrased as 

k 

tr Q = £; ■ Q e M where E ■.= ^ e^e* (31) 

1=1 

and, on the right hand side, both E and Q are taken as elements of 5", i.e. as n- 
dimensional vectors. Using this, we define 

-^[v) ~ T„Qv'„ e 5" C C"' and ^(w) ET, e C"\ (32) 

Computation of ~^{v) and ^{v) can be taken as performing a quantum random walk 
version of the Forward and the Backward algorithm. Correspondingly, entries of ~^{v) 
and ^{v) reflect Forward and Backward variables. 

4.3 Runtimes 

Since the multiplication of an {n x n)-matrix with a vector can be done in 0{n^) 
arithmetic operations, the previous considerations let us conclude: 

Lemma 1. Given M or Q let n be the number of hidden states \S\ resp. the dimension 
of the state space 5" associated with Q and p be the probability function of M. or Q. 

1. For any v G S* 

lJ'(w),^(w) and p{v) (33) 

can be computed in 0{\v\n^) arithmetic operations. 

2. Upon computation of~^(w) computation of all 

p{wa) and ~^{wa) (34) 

requires 0{\S\n'^) arithmetic operations. 

3. Upon computation of^{v) computation of all 

p{av) and ^{av) (35) 

requires 0{\S\n'^) arithmetic operations. 

4. Upon computation of'${w) and ^ {v) computation of all 

p{wav) (36) 

requires 0(|Z'|n^) arithmetic operations. o 

For hidden Markov models Ai this actually reflects well-known results on compu- 
tation of Forward/Backward variables. 



5 Equivalence Tests 

In this section, we describe how to efficiently test two hidden Markov processes or 
quantum random walks (Xt) and (Yt) for equivalence. We recall that a generic strategy 
has been established by theorem|2l Our solution proceeds according to this strategy. 
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5.1 Computation of a Basis 

We will now show how to compute a basis (/J) in runtime 0(|Z'|n^) for a hidden 
Markov process resp. a quantum random walk p. Therefore, assume for now that gi, . . . ,g,, 
Z"* — ?> M are probability functions the probabilities of which can be computed in the 
style of hidden Markov processes resp. quantum random walks and which generate the 
column space of p, i.e., 

C{p) C span{5i, . . . ,g„}. (37) 

Given gi, . . . , g„, computation of a basis (/J) proceeds in three steps the first two of 
which are analagous and the third of which is a simple procedure. 

1 . Compute a row generator /. 

2. Compute a column basis J. 

3. Reduce / to a row basis. 

While steps 1 and 2 both require runtime 0{\X!\n^), step 3 requires O(n^) which over- 
all evaluates as 0{\U\n'*') runtime required for computation of a basis. 

We discuss the steps in the following paragraphs. In a subsequent subsection, we 
show how to obtain suitable gi, ...,gn for both hidden Markov models and quantum 
random walks. 

Step 1: Computation of a row generator I Consider the following algorithm. 

Algorithm 1 

1: Define g(v) = (.9i(v), g„(i;)) e R". 

2: / ^ {□}, Bro^ ^ {g{n)}, Crow ^ S. 

3: while Crow ^ do 

4: Choose V G Crow- 

5: if ^(v) is linearly independent of Brow then 

6: I ^ I\j{v},Brow'^ Brow^{^{v)} 

Crow ^ Crow U {av | a G 17} 
7: end if 
8: end while 
9: output /. 

Proposition 1. Let I C U* be the output of Algorithm\l\ Then one has 

TZ{p) = span{p„ | u e /} and dim(Xt) < |/| (38) 

where 

C{p) = span{(7i, . . . ,5„} ^ dim(Xt) = |/|. (39) 

Furthermore, 

(i) The algorithm terminates after at most n iterations. 
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(ii) Each iteration requires 0{n^) arithmetic operations where at most n iterations 
need additional 0{\Z!\n^) operations. 

Proof. Ad (i): Because the n-dimensional vectors in Brow are independent \Brow \ < 
n and |/| < n follow immediately. Since at most S words are added to Crow upon dis- 
covery of an n-dimensional vector which is linearly independent of those in Brow^ we 
have |Croi«| < l-^'j • n and hence at most |£'| • n iterations. 

Ad (m): In each iteration, we perform a test for linear independency of at most n 
vectors of dimension n which requires at most 0{n?) arithmetic operations 1 10 |. In the 
at most n cases where g(t;) is linearly independent of Brow, we proceed by computing 

(5i(au), ...,g„(au)) and {^i{av), ...,^{av)) (40) 

for all a e where (^(u), ^(u)) are available from an iteration before (note that 
(7i(n) = 1, ^(n) = (1, 1) in the first iteration). Due to lemma[T] (|35] l. this requires 
0(|i7| • n?) operations. 

To prove dSST l, let vq G E* be arbitrary and suppose 

g(t;o) i span{g(t;) \ v (41) 

We will derive a contradiction. Indeed, the algorithm can only miss wo if wq had never 
been collected into Crow in step 6. This happens only in case that there is a G S* 
such = wiiuo holds for some vi e S* and g(wo) had been found to be linearly 
dependent of [g(w)]t,e/. 

However, this is a contradiction to Lemma|2]below, which states that in such a case 
Py„ e span{p„ I w G /} holds. 

To see ( [39] l let Am\{Xt) < \I\. Since |/| = \Brow \ we obtain that 

dimC(p) = dim{Xt) < \Brow\ < dimspan{gi, . . . ,5„} (42) 

hence C(p) C span{gi, ...,gn}- o 

Lemma 2. Let gi, . . . , f;„ : S* R be such such that C{p) C span{f;i, ...,(;„} and 

let vqjVi, Vm G S* be such that 

(gi(wo), ■■■,gn{vo)) G span{(5i(uj), ...,g„(wj)) \j = l,...,m} C R". (43) 
Then one has for every w G U*: 

Pwvo 6 span{p^^^. I j = 1, to} C R". (44) 
The analogous statement holds for the row space TZ{p). 
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Proof. By our hypothesis, there are scalars Pm G K such that 

m 

(5i(uo),...,5n(wo)) = ^/3j(5i(wj),...,5n(wj)). (45) 
i=i 

Let u £ Z'* be arbitrary. Again by our hypothesis, there are scalars ai,i = 1 , . . . , n £ K 
such that 

n 

P« = X!'^*5i- (46) 

4=1 

We now compute 



1=1 

n m m n 

m m m 

51 ft3"(^j) = l^jP'^'^'"]) = XI ^J'^'^j 
j=i i=i j=i 

Since the had been determined independently of u, we thus conclude 

m 

i=i 

Let CTtu be the linear operator on Jl{c) with the property 

0-wPv=Pvw (48) 

Application of to (|47] l then shows 

m m 
P«0M> = (Pvo ) = X! ft '^'^ (^^^'J ) " X! ft ^'"J ' ^"^^^ 

which implies (|44] |. o 



Step 2: Computation of a column basis J Having obtained the row generator ICE* 
in the step before, that is dim(Xi) < |/| and 

n{p) = span{p^ I « G (50) 

we can now use these functions py as an input for an algorithm which is analogous to 
that for computing the row generator /. 
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Algorithm 2 

1: Define q{w) := {pv{w) = p{wv),v £ /) G M'-^L 
2: J ^ {□}, B,oi ^ Ccoi ^ S 

3: while Crow 7^ do 
4: Choose w G C col- 
s', if q{w) is linearly independent of B^oi then 
6: Acoz ^ Acoi U {w}, Bcoi ^ Bool U 

Ccoi ^ Ccoi U {wa I a G 17} 
7: end if 
8: end while 
9: output J 

While this routine is, in essence, analogous to algorithm [T] there is one difference 
to be observed: Here Cool gets augmented by joining wa whereas Crow, in algorithm 
[T] was augmented by joining av. This asymmetry is due to that one obtains an equiv- 
alently asymmetric statement in lemma|2]when rephrasing it for TZ{p) instead of C{p). 
As a consequence, application of ( |34] | instead of (l35T l in lemma[T]is needed. 

We obtain that 

PiJ = (51) 
is a generator for (Xf ). Since TZ{p) — span{p„ | v G /}, by applying ( [39] l, we see that 

|J|=dim(Xt). (52) 

Hence J is a genuine column basis. We recall that this was not necessarily the case for 
I which can happen to occur in the case C{p) C spanjiji, 

All p{wav),v ^ I,w E J,a ^ S can be obtained in runtime 0(|i7| • n'^) through 
application of (|36] | in lemma [T] making use of the '^{w), ^{v) which were computed 
when executing the algorithms [T]|2] 

We conclude: all necessary quantities can be obtained through 0{\X!\-n^) arithmetic 
operations. 

Step 3: Making I a basis This step is simple: one removes v from / where p{wv) , w G 
J is linearly dependent in Pjj. This reduces the possibly too large set / to a row basis 
and finally yields a basis (/J) for (Xt). This requires at most n linear independence 
tests of n-dimensional vectors hence 0{n'^) runtime lilOJ . 

5.2 Generating sets 

Let us call a set {gi, ...,(;„} of functions g,; as in the previous section a set of gener- 
ators for the column space C{p) of the hidden Markov process resp. quantum random 
walk {Xt). 

We can get sets of generators as follows for which probabilities gi{v) can be com- 
puted in the style of hidden Markov processes resp. quantum random walks as follows. 
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Hidden Markov Processes Given a hidden Markov model M ~ {S,E,Tr,M), con- 
sider the hidden Markov models Mi = {S, X, e^, A/), where is the ith unit vector in 
M.^ . One now takes 

g,{v)^efm = (53) 

Quantum Random Walks For a quantum random walk, as parametrized through a 
self-adjoint matrix Q^j, and linear operators Ty,v G S* (acting on the state space see 
subsection |4.2| ). we see that 

g^{v)=tTT,Q, {i = l,...,n) (54) 

where the Qi comprise all of the state space basis members Emim2 1 Fmim2 

(see (l25Ti). 

5.3 Summary 

Theorem |2] yields the following procedure as an efficient test for equivalence of pro- 
cesses (Xt) and (Yt), : 

1. Compute a basis for both (Xt) and (Yt). 

2. If dim(X() 7^ dim(l^) return not equivalent. 

3. If dim(Xf ) = dim{Yt), perform equality tests from ( fTST l. 

4. Output equivalent if all of them apply and not equivalent if not. 

According to the above considerations, Step 1 can be performed in 0(|Z'|n^) run- 
time where 

n — max{nx, ny} (55) 

and nx,nY, in case of hidden Markov processes (Xt), (Yt), are the numbers of hid- 
den states and in case of quantum random walks (Xt), (Yt) are the dimensions of the 
associated state spaces. For step 2 we recall that all strings participating in the bases, 
as computed through algorithms 1 1121 emerge as extensions of basis strings obtained in 
an earlier iterations. Application of (|34|35l36l l from lemma [T| then yields that all of the 
equaUty tests can be equally performed in 0{\X!\n'^) arithmetic operations. 

These insights can be condensed into the following main theorem where n as in 
(ED. 

Theorem 3. The equivalence problem can be algorithmically solved for both hidden 
Markov processes and quantum random walks in 0{\X!\n^) arithmetic operations, o 

Probabilistic Automata Our solution can be straightforwardly adapted to determine 
equivalence of probabilistic automata which we will describe in the following. It can 
therefore be viewed as more general than the main result obtained in |21 1. The main 
difference one has to keep in mind is that probabilistic automata induce probability 
distributions on the (countable) set of strings S* whereas HMMs give rise to stochastic 
processes, in other words to probability distributions on the (uncountably infinite) set of 
sequences 17'^. in case of probabilistic automata equivalence then translates to equality 
of the associated probability distributions on S*. The following notations are adopted 
fromini- 
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Corollary 1. Let Ai = {Si,S,Mi,tti,Fi),A2 = {S2, I^, M2,t^2, F2) be two prob- 
abilistic automata where Ni — — \S2\- Then equivalence of Ai,A2 can be 
determined in 0{{\i:\ + 1)7^) where N = max(A^i, A^2)- 

Proof. By adding a special symbol $ to which is emitted from the final states 
with probability 1 the automata Ai , A2 can be transformed into probabilistic automata 
with no final probabilities Ai,A2- Let p_^^,p^^ be the resulting stochastic processes. 
According to [5], lemmata 3 — 5, proposition 8, probabilistic automata with no final 
probabilities can be can be viewed as HMMs A^i, A^2 which translates to that for each 

PAi{v) ^ PMi{v) and (w) = Pa42 («)■ (56) 

Note that the transformation from A1.2 to requires only constant time. Applying 
theorem[T]to 1 , y\/(2 yields the result. o 

In short, corollary scales down the runtime 0{{Ni + iV2)^) (the size of the alphabet 
is not discussed in tUJ) to 0((max(iVi, A'^2))'^)- 

Ergodicity Tests In 1201 . a generic algorithmic strategy for testing ergodicity of hid- 
den Markov processes was described, where overall efficiency hinged on computation 
of a basis of the tested hidden Markov processes. The algorithms described above re- 
solve this issue. Hence ergodicity of hidden Markov processes can be efficiently tested. 
Similarly to the equivalence tests, the ergodicity test of f20l solely requires that the 
process in question is finitary. Therefore this efficient ergodicity test equally applies for 
quantum random walks. 

5.4 Conclusive Remarks 

We have presented a polynomial-time algorithm by which to efficiently test both hid- 
den Markov processes and quantum random walks for equivalence. Previous solutions 
available for hidden Markov processes had runtime exponential in the number of hid- 
den states. To test equivalence for quantum random walks, that is random walk models 
to be emulated on quantum computers, is relevant for the same reasons that apply for 
hidden Markov processes. An algorithm for testing equivalence for quantum random 
walks had not been available before. Note that the algorithm presented here is easy to 
implement and, in particular for hidden Markov processes, only requires invocation of 
well-known standard routines. Future directions are to explore how to efficiently test 
for similarity of hidden Markov processes and quantum random walks where similarity 
is measured in terms of approximate equivalence. Such tests have traditionally been of 
great practical interest. 
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